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Extended inequalities for weighted Renyi entropy involving 
generalized Gaussian densities 

Salimeh Yasaei Sekeh 


Abstract 

In this paper the author analyzes the weighted Renyi entropy in order to derive 
several inequalities in weighted case. Furthermore, using the proposed notions a-tli 
generalized deviation and (a,p)-th weighted Fisher information, extended versions of 
the moment-entropy, Fisher information and Cramer-Rao inequalities in terms of gen¬ 
eralized Gaussian densities are given. 


1 The weighted p-Renyi entropy 

In 1960, Renyi was looking for the most general definition of information measures that 
would preserve the additivity for independent events and was compatible with the axioms 
of probability. He started with Cauchy’s functional equation and he ended up with the 
general theory of means. The consequence of this investigation derived the definition of 
Renyi entropy, see M- In addition, Stam [T9] showed that a continuous random variable 
with given Fisher information and minimal Shannon entropy must be Gaussian. However 
the moment-entropy inequality established the result saying: a continuous random variable 
with given second moment and maximal Shannon entropy must be Gaussian as well. Cf. 

mmmm- 

Furthermore, The Cramer-Rao inequality shows that the second moment of a continuous 
random variable is bounded by the reciprocal of its Fisher information. Cf. [7j. Currently in 
[E], the notions of relative Renyi entropy, (a,p)-th Fisher information, as a general form of 
Fisher information associated with Renyi entropy including cc-th moment and deviation has 
been introduced. More results and certain applications emerged in m HD [2113]. Later, an 
interesting generalization of Stain’s inequality involving the Renyi entropy was given, check 
again m, wherein it has been asserts that the generalized Gaussian densities maximizes 
the Renyi entropy with given generalized Fisher information. 

The initial concept of the weighted entropy as another generalization of entropy was 
proposed in in si]. Certain applications of the weighted entropy has been presented in 
information theory and computer science (see mmmmm)- 

Let us now give the definition of the weighted entropy. For given function x G M H > 
ip(x) > 0, and an RV X : Q —> M, with a PM/DF /, the weighted entropy (WE) of X (or 
/) with weight function (WF) ip is defined by 

h ™( x ) = h™(f) = - [ (p(x)f(x) log f(x)dx = -E.v^log /) (1.1) 

J R 
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whenever the integral J tp(x)f(x)y 1 V | log f(x)\jdx < oo. (A standard agreement 0 = 

0 • log 0 = 0- log oo is adopted throughout the paper). Next, for two functions, x G M i->- 
f(x) > 0 and x £ M g(x) > 0, the relative WE of g relative to / with WF p is defined 
by 

Dy(f\\g) = [ <p(x)f(x) log^|dx. (1.2) 

JR 9\ x ) 

When p = l the relative WE yields the Kullback-leibler divergence, we refer the reader 
ESI 120]. Following the same argument as in the WE, here, we propose a generalization 
form of the WE named p-th weighted Renyi entropy (WRE). As we said, the aim of this 
work is to extend the aspects introduced in m to the weighted case. On the other hand, 
the famous assertions like the moment-entropy, the Fisher information and the Cramer-Rao 
inequalities are generalized to the weighted case referring the generalized Gaussian densities. 
One sees if p = 1 the results coincide with the standard forms. 

In author’s opinion, this work is devoted in a similar way as analysing the Renyi entropy by 
elaborating newly established assertions for the WE. This leads several interesting bounds 
stem from the particular cases of a and p. Let us begin with the p-th WRE’s definition. 

Definition 1.1 The p-th weighted Renyi entropy (WRE) of a RV X with probability density 
function (PDF) f in M, given WF p and for p > 0,p ^ 1, is defined by 

KA X ) '■= KM )= log [ M)f p i x ) dx - ( L3 ) 

1 — P Jr 

Observe that if p = 1, the WRE, K% p (f), becomes the known Renyi entropy, denoted by 
h p (f), cf. [751 /. Moreover, we propose the p-th weighted Renyi entropy power (WRP) of a 
PDF f by 

MM) = ex p {KM)) • ( L4 ) 

Here and below we assume that integrals are with respect to Lebesgue measure over the real 
line M and absolutely convergent. Throughout the paper we also suppose that the entropies 
are finite as well as the expectation Kf\p\. Observe that 

= JVJi(/) = exp (^jj- (1-5) 

On the other words as p —> 1 the WRP intends to the weighted entropy power (WEP), see 
nnmif. Note that both h(f p (f) and N™ p (f) are continuous functions in p. 


Remark 1.1 Recalling the definition of ( a,p)-th Fisher information (FI) of PDF f with 
derivative function f: 

Mpif)) 1 = I \f p ~ 2 f'\' 3 fdx, for (5 £ (l,oo],a € (l,oo), (1.6) 

J M 

and a -1 + /3 _1 = 1. Particularly p = \ f\^ / f reads an obvious relation 

/ \/3r/(l -p) 

MM) = [ J Mf)) where r = (p + 2(3- 2 )/p. 

This explains a practical fact that all drived assertions in terms of p-th WRE can be applied 
for the ( a,p)-th FI as well. For more details refer 0 BJ 177/ . 
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Remark 1.2 Given PDF f and the WF p, set x = E/ [p\- For weighted PDF f, p := p f jx 
one yields 


h™P, p (f) = hpifp) + log\. 

Next, extending the standard notions, we can also introduce the relative p-th WRP of f 
and g: for p > 0,p ^ 1 and given WF 16 I 4 p{x) > 0 

f dx) ( y ¥> g p dx 

r \ 1 /p( l ~P) 

/ p f p dx) 

Jr J 

Further, more generally, for given two functions f and g we employ the relative p-th WRP 
and define the relative p-th WRE of f and g by 

D™ p (f\\g) = logN™ p (f,g). (1.8) 




Then one can obtain 

D™ p (fWg) = ^log (f <P9 p - 1 f dx) + ^K tP (g) - hl p (f). (1.9) 

Therefore when p —> 1, one yields 

N %1 (/, 9) = N™ p (f, g) = e X p | j ■ (1-10) 

Evidentally as p —> 1, the relative p -th WRE does not imply the relative WE accurately, 
although it is a proportion of D p (f\\g), (11.101) . Going back to (11.71) . the relative p-th WRE 
is continuous in p. 

Theorem 1.1 Given non-negative PDFs f, g and WF p, one has 
(a) Ifp>0,pjH 


D™ p (m > 0- (1-H) 

(b) For p = 1, given WF p, suppose the following inequality 

E ff M < Ef[<p\ (1.12) 

is fulfilled, then holds true, that is D p l (f\\g) > 0. In both (a), (b), equality occurs 

iff f = 9- 


Proof The case p = 1 follows by using the Gibbs inequality, cf [ 2Uj . 


-D^ifWg) 

< [ T f !(/ > 0) 

Jm. 


< 


E f[<p\ 

1 

E f[<p\ 


7 _1 


dx 


/ p g dx- / p f dx \ < 0, 
Jr Jr j 


owing to (11.121) . 
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If p > 1, owing to the Holder inequality (see Lemma 1 cf. m) , one can write 


[ V9 P 1 f dx = f (tp p gY (p p f) dx 

J M J IR 


< 


(p g p dx 


p-i 

p 


ip f p dx 


Next for p < 1 one also derives from the Holder inequality: 

ip f p dx = j [(p g r * / ) \ip g- 

Jr 

< 

The equality takes place from the equality in the Holder inequality. 


nP- 1 fY f,nnPY ? dx 


f T 9 P 1 / dx) ( f (p g p dx 
J M / \ J M 


1 ~P 


Example 1.1 Let the WF be <p(x) = exp(jx), 7 G 1, Consider the PDFs f ~ Exp(Ai), 
g ~ Exp(A 2 ) such that Ai,A 2 > 0. Then for p > 0, p 7 ^ 1 under the following list of 
suppositions: 


A 2 (p — 1 ) + Ai — 7 > 0 and Aj p — 7 > 0 , * = 1 , 2 . 


we compute 


d 7 (/ii«) = r 7 lo s( 


-1 


AiAf 

'A 2 {p - 1 ) + Ai - 7 


1 . / A£ \ 1 . / A? 

- P log (y^) - ttto g 


(1.13) 


Pictorially it can be seen that for p ^ 1, hi. 13 I) takes non-negative values. Now for 7 < 0 
implement hi. 12 Ik 


Ai(A 2 — 7 ) > A 2 (Ai — 7 ) Ai > A 2 (1.14) 

In particular choose p = 1. applying some straightforward calculations leads 

D?,i(/ll9) = i°gh + hnL. ( 175 ) 

Here also 7 < 0. Performing simple numerical simulation, one can show the behavior of 
Dpi(f\\g) for chosen value Ai, A 2 over selected range 0 / 7 . It can be indicated that for 
instance if 7 E (-5,-1), in special case Ai = 0.1, A 2 = 1, the both inequalities \1.12 \) 
and hl.ll\ ) in p = 1 are violated. Whereas one can demonstrate when 7 E (-0.04,-0.01), 
Ai = 0.1 and X 2 = 0.2, the assertion 11 . 111 ) holds true while the assumption h!.12h ) is not 
satisfied. Further, with the same forms of f and g, we observe that bounds 11.111 ) and h!.12\ ) 
are fulfilled with Ai = 3.5, A 2 = 1.5 and 7 E (—10, —1). 

Definition 1.2 Given the WF x E R 1 — > ip(x) > 0 and a E (0, 00 ) we introduce the a-th 
generalized moment of a PDF f as follows: 

P' P ,a(f)= [ ip{x)\x\ a f(x) dx. (1.16) 

Jr 
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Considering that the integral exists. Sequently define the a-th generalized deviation of 
the PDF f for a £ [0, oc]: 

ip(x)f(x) log 

k esssup{p(x)\x\ : f{x) >0} a = oo. 

Note that all definitions are valid when the integrals exist, on the other hand the expressions 
are finite. Also it is worthwhile to mention that c (/ , iQ ,(/) is continuous in a. Observe that 
taking ip = 1, \1.17\ ) coincides with the standard p-th deviation, (6) in !T3f. 

Remark 1.3 Assume for a £ (0,oo) the function g(x ) = /(x) \x\ a /x : K 4 C, where 
X '■= Ej[|x|"], is integrable. For any real number £, let <p(x) = e ~ 2mx ^. Then a-th gener¬ 
alized moment of f becomes a proportion of the Fourier transform for g, i.e. g(f). Also in 
special case <p(x) = e ltx , t £ R the g v , a {f) equals the proportion of characteristic function 
for g. 

Furthermore, consider ip addresses to the non-negative polynomial function of \x\, that 
is for which constants ao,... ,a n that 

<p(x) = a n \x\ n + a n _i|x| n_1 H-b ai|x| + a 0 . (1.18) 

and p > 0. Then one obtains 

n 

h<p,a(f) = 'y ] a i ha+i{f)- 

i=0 

Here g a+ i(f) stands a + i-th moment of f defined in IIW . 

Example 1.2 Let p(x) takes the form hi. 18 1) . X ~ Exp{ A). Then 



In spite of a-th moment, this function is not always increasing in a £ (0, oo). For instance 
let n = 3, ao = 1, a\ = — 2 , a 2 = —1, 03 = 2 and A £ (0.5, 1 . 2 ), then <J. fi . a {f ) decreases in 
the range a £ ( 1 , 2 ). 


o. 


(p,Oi 


(/) = 


exp 


E f [p\ 

(/V,a(/)) 1/a 


/ 
J R 


|x| dx ) a = 0 , 

a £ ( 0 , 00 ), 


(1.17) 


2 Generalized p-Gaussian densities 


Let us continue the paper with weighted information measures of generalized p-Gaussian 
densities. For this, let X be a RV in R. Then for a £ [0, 00 ] and p > 1 — a, the generalized 
p-Gaussian has the PDF 


G(x) = < “°J >( 1 + ( 1 -2>)lfl“) 

[ a a , 1 exp { - \x\ a ) 

here we use the notation (x) + = max{x, 0 } and 

a(l — p) l / a 


!/(/>—!) 




2/?(s.i=£-s) 

a 


2r d) , 

a(p — l) 1//o 


1, 

p = 1 , 


p < 1 , 
p = 1 , 


( 2 . 1 ) 
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p > 1 . 













( 2 . 2 ) 


Note that for p > 1 and a = 0 the G is defined almost every x £ R as 

G{x) = a 0)P ( - log |x|)^ /(p_1) , here a 0 , p = l/2T(—^-j). 

In addition, in case a = oo and p > 0, the PDF G is given as follows: 

G(x) = { 2 N - 1 ’ , (2-3) 

(0 |x| > 1, here a oo )P = ^■ 

In the context of communication transmission, a model PDF can characterize the sta¬ 
tistical behaviour of a signal. For multimedia signals, the generalized Gaussian distribution 
is often used, cf. m- The generalized Gaussian can be applied to model the distribution 
of Discrete Cosine Transformed (DCT) coefficient, the wavelet transform coefficient, pixel 
coefficient and so on. Thus, it might be used in video and geometry compression. This 
distribution is also known in economic as Generalized Error Distribution (GED). We em¬ 
phasize that the generalized Gaussians are also the first-dimensional version of the extremal 
functions for sharp Sobolev, log-Sobolev and Gagliardo-Nirenberg inequalities. Cf. |9j. 


Now, passing to the generalized weighted Fisher information we establish the following 
definition. 

Definition 2.1 For given a £ [l,oo] and p € R, the ( a,p)-th weighted Fisher informa¬ 
tion (WFI) of a PDF f denoted by Ja’p(f) is defined in different cases: If a £ (l,oo), let 
/3 £ (l,oo] be the Holder conjugate of a, or 1 + /3” 1 = 1. The Ja,’p(f ) is proposed by 


j: 


7(f) = [ V\f P ~ 2 ff f dx. 
JR 


Note that the PDF f is absolutely continuous. If a = 1 then ( 


VP 


(2.4) 


is the essential 


supremum (assuming to existence) of tp \ f p 2 f'\ on the support of f. If a = oo similar in 
‘lSj, the Ja,’p (/) is given by 


V(<p F/p ) - / !>' F/P dx, 


(2.5) 


where V(f) is the total variation (here assuming f p has bounded variation) and tp 1 denotes 

the derivative of WF p, <p'(x) = — p(x). It can be easily seen that when ip = \ the integral 

dx 

in vanishes. For more details, we once more address the reader HM E3 E3 E3 H d- 
Remark 2.1 In special form ip = f k \f'\ m , k £ R, m > 1 — j3 one obvious formula reads 

( V P ' 

W) = iJa'Af)) , ( 2 - 6 ) 

where a' is the Holder conjugate of fi' such that 

fi 1 = m + fi, p' = (k + p(3 + 2m) / (m + f3). 


If we deal with the WF tp as a polynomial function of f: tp = 6* f l where bi , i = 0 ... n 

are constant and tp > 0. Then one has 


i =0 


■£W = EM-W/) 


2=0 


PPi 


Pi=P + 


7 


(2.7) 


Note that J. r (f) stands as before in \1.6\) . By looking at \2.7\ ) it’s not difficult to deduce 
the ( a,p)-th WFI is not necessary decreasing in a for given p. 
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In what follows, we will also use notation E(X) for the expectation relative to RV X 
with the PDF /. For arbitrary RV Z and given WF </?, set 


a ^( z) - e M { \ p - 1 ) } 




(f (l-Z) } t/c 

U(p-1) j 




( 2 . 8 ) 


(1 ~P) 


Assuming all expectations are finite, the notations below are proposed allowing us to shorten 
the formulas throughout the paper: 

0«(Z)=e{^(-Z 1 /“) + ^(Z 1 /“)}, T(Z) = e|<^(— e _z ) + <^(e -Z ) j. (2.9) 

Next, by virtue of Definitions m, a and m, a list of weighted information 
measures for PDF G in various cases of a, p is established: 

• For a G (0, oo) and p > 1, we start with an explicit form of N^ p (G). Therefore after 
not complicated computations, one obtains 


N^JG) = a-] r 2 1 «»- 1 > 


pa nVR-p) 


p a + p 




{KAz)} 


i/(i -p) 


( 2 . 10 ) 


where Z ~ Beta ^1/a, (2 p — 1 )/(jp — 1)^. Also assume RV Y has Beta distribution 
with parameters p/(p — 1), (a + l)/a. Then owing to ()1 . 17|) . one can write 


<?u 


’ V A G ) = {( 2 (pa + p- 1)) 1 A </ , iP (V)| / . 
For a subset of cc as [1, oo) and p > 1, observe 

J^(G) = (2{ap + p- l))' 1 a? 1 V , P (Y). 


( 2 . 11 ) 


( 2 . 12 ) 


Note that here /3 is the Holder conjugate of a. Consequently we have the following 
assertion involving N^ p (G), o- V: a(G) and Ja’p(G ): 


rc p (G)] I “* = P <V„(G) Kif(G)] W 


(2.13) 


For a G (0, oo) and p G (1 /(a + 1), 1), consider two RVs Z and Y having Beta PDFs 
with parameters p(a + 1) — l)/a(l — p), 1/a and ( p(a + 1) — l)/a(l — p), (a + l)/a 
respectively. With analogue manner one has 


JVJ r (G) = a-y/<r-i) 




and the expression (|1.17l) becomes 


i,a(G) = {(2(pa + p- 1)) 1 A^ p (V)| 1 . 


o. 


(2.14) 


(2.15) 


Substituting A p . p (Y) in A <p, p (Y) in (12.1211 and taking into account the previous argu¬ 
ments, Ja,'p (G) is derived when a G [l,oo). Thus 


[^ p ( G )] 1 v = pa ^[ G ) [ J ^( G )] 1/0 


(2.16) 
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Let a £ (0, oo) and p = 1. Suppose RVs W, W have Gamma distribution with same 
rate parameter 1 but different scale parameters (a + l)/a, 1 /a. To specify the p -th 
WRE, one yields 


K(G) = E G [^](log a-\) + (2 ay'QaiW). 
Consequently, it can be seen 

N^p(G) = a“\ exp{0 Q (lT)/«0 a (TT)}, 


(2.17) 


(2.18) 


a v AG) = (2 a)~ l / a {Q Q (W)} 1/a . 

Recalling (12.41) once again, one can write a representation for the (a, l)-th WFI: 

Ja,f(G) = 2- 1 a^~ 1 0 a (W). (2.19) 

Here 0 Q stands as the formula in (12.91) . Also it can be checked 

2 <v,a(G) [Jaf(G)\ 1/0 = Q a (W). (2.20) 


• Case a = 0 and p > 1. In a modified setting Consider three RVs X,X,X having 
Gamma distribution with shape parameters (2 p — 1 )/(p — 1), l/(p — 1), p/(p — 1) 
respectively and rate parameter 1. Then one gives 


N vA G ) a o,p{ 2 (p-l)) 

v<p,o( G ) = ex P { “ ip - !) 


p \ i/(i-p) 


{t(V)} 


!/(!—P) 


( 2 . 21 ) 


rx 

For a = oo and p > 0, set x ) = / p(t) dt. According to (11.41) one has the 

Jo 

respective formula 

N™ p (G) = 2P/&-V (</>(l) - ^(-l)) 1/(1_p) . (2.22) 

Finally (11.171) admits the representation u^ :00 (G) = esssup p{x). Regarding to con- 

pX 

elude this part, for derivative function ip', set ip(x) = / p\t) dt, then 

Jo 

^(G) = (p2>r 1 [^(l)-V-(-l)] -2- 1 -"p:(l)-«-!)]. (2.23) 

Consequently 

[^(G)] 1_P = P J^(G) - p 2~ 1 ~r [?(1) - ?(-!)]. (2.24) 


Eventually for t > 0 define Gt : K —>• [0, oo) as the form 

Gt(x) = - t G^), 


(2.25) 


which later in Section 3 will be used. 





3 Main extended inequalities 

We start with an extension of the moment-entropy inequality which will be applied to obtain 
an extended form for the Cramer-Rao inequality. Further, let us discuss a kind of general 
version of the Fisher information inequality reflecting the properties of WFIs. In essence, 
Theorems 3.1-3.3 are deployments of their counterparts from [13] . Throughout this section 
we use a number of properties established in Sections 1 and 2. 

Theorem 3.1 (The extended moment-entropy inequality (MEI) cf. [13] . Theorem 2.) Consider 
f is any PDF. For given WF ip and G represented in Section 2, set 

(!U) 

Here (T v , a {-) represents the a-th generalized deviation. Consider a £ [0, oo], p > 1/(1 + a) 
and the following assumptions hold: 


E f[ip\ > E(j[<£] and together with E f[ip\ > Ec[y?*], if p = 1. 


(3.2) 


Then 


°V,a(/) 

With equality if and only if f = G. 


N™ p (f) { N ^ G) J 


i -p 


&(p,a (G) 


(3.3) 


Proof: Following arguments in Theorem 2, cf. H3j, we provide the proof in different 
cases: first for simplicity set a = a ayP and 


tip — 


^IptOlif) 


a ip,a(G) 

Case 1: a € (0, oo) and p / 1. Owing to (|2.1I) and (12.251) one can write 


(3.4) 


[ T GP t v l f& x 
Js. 

>a p ~H^ p J <p(x)f(x) dx + (1 - p)a p ~Hl,~ p ~ a J ip(x)\x\ a f(x)dx 
= + (1 ~ P)tp a Pp, a (f)), 

Going back to (13.21) . the RHS of (13.51) is greater and equal than 

a p-1 iJr p (E G [p] + (1 - p)p^a(f)) = t l ~ p [ <p G p dx. 

J R 

Note that the equality holds if p < 1 and equality occurs in (|3.2I) . 


Case 2: a = oo and p / 1. Observe that when a = oo, / vanishes outside of interval 
[—tip,tip\- So one derives 


[ TG p t 1 f dx = 

I R 


> 


a p i t l p jt^ dx 

a p ~ l t l p~ Pl &G[ip\ = tp~ p f ip G p dx. 


(3.6) 
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Here the inequality holds because of (13.211 . The scaling identity also can be checked for G+ : 

[ <P( x ) G tA x ) dx = t l ~ p f p{t lf x)G p {x) dx. (3.7) 

J R J R 

With regard to <p*{x) = <p(t<p x), recalling (13.511 . (13.611 and (13.711 . one yields 


1 < ( N^ p (f,G t<p ) 

[ G L dx 


<p f p dx 


= t u 


p G p dx 


1-p 


/ 

Jr 


i -p 


<p G L l f dx 


v 

i -p 


p*G p dx).N- l p (f) 


(3.8) 


< 


o u 


q(/) UV£p(G) 1 (1V£, P (G) 


i -p 


Vcp,a( G ) ' 




implying (13.311 . 


Case 3: a £ (0, oo) and p = 1. By virtue of (J3.2I) and the Gibbs inequality in [20| 
one has 

D^(f\\Gt v ) _ K{f) 


0 < 


*M~— I7M“ log “ + logt * + V W 

Using (I3.2H and (1 3.11) we conclude the required result in this case by 

KU) , 


o < -- 


+ 


+ log V<p,a(f) ~ l°g 0>,a(G). 


IE f[p\ Eg[v?] 

Case 4: a = oo and p = 1. With similar analogue method in case 3, one obtains 


0 < —^ 


DZUWGt. 


K(f) 


-log a + log tu 


Kf[(p] E f [tp\ 

h”(f) t h™(G) 

1 ^ +log cr^ooif) -log 0 ^, 00 (G). 


/ 

Jr 


(3.9) 


/ 

JR 


E/[^] + E g [v?] 

Case 5: a = 0 and p > 1. Owing to (11.1711 : 

<£> G p dx = —a p_1 E G (t/?) log (G). 

By virtue of (13.211 . (11.1711 and (13.41) . it turns out 

V G tjf ds 

> E/M ^t}r p o p_1 log - fjT P a p_1 log <7 Vl0 (/) 

tjp p f p G p dx. 

Jr 

Taking into account (13. 811 the result is verihed. According to the Gibbs inequality, the 
equality occurs iff / = Gt , for some t<p £ (0, oo), where this is implied from f = G. ■ 

In addition, an immediate application of Theorem 13 .1 1 bv choosing p = a = 1 in Corollary 
o can be established as the following: 


(3.10) 


= tj 
> 
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Corollary 3.1 Consider RV X with the PDF f. Let <p(x) = \x\ c , c £ R. For a £ [0, oo], 
set 


tc(f,G) : = 


( g c+a (f) \ c{c + a)/a 


V ®c+a (G) J 


Suppose that PDF f obeys 


Ey[|AT| c ] >Eg[|X| c ], and together with, 
E f [\X\ c ] >E G \t c (f,G)\X\ c ], if p= 1. 


(3.11) 


(3.12) 


Then for p > 1/(1 + a) 

0>,a(/) c+1 > <J IP}P (G) C+1 


^p(/) ~ N %r(G) 


equivalently 


N™ p (f) ~ N% p (G) 


(3.13) 


Here C a = (c + l)(c + a)/a. Consequently following J2t IT5j/ . the appropriate extremal 
distribution maximizes 


N^p(f) = ( [ \x\ c f p (x)da 
\ »/]R. 


vo-p) 


with the same c + a-th moment. On the other hand a direct assertion can be expressed as 
the following: for any PDF / :li->R where satisfies in suppositions 


K f [\X\ c \>d, E f [\X\ c }>-^-(E f [\X\ c+1 ]) C , c £ 


c+1 


One yields 


{c+iy.N - h i(/) 


2 e c+1 


< 


f \x\ c+1 f(x)dx. 

Jr 


(3.14) 


(3.15) 


The equality occurs when f = —e Note that for instance if f ~ Exp( A) for chosen 

ranges A € (3, oo), c £ (—1,0), both inequalities in {3.1$ axe fulfilled. This implies \3.15\) 
as one of the variate possible bounds for WRP. 

In this stage the author analyses another particular case p = 2, a = 1 in Theorem 13.11 in 
order to explore one more result below. 

Corollary 3.2 Define the quantity m{c) by 

r)2—C 


(c + 3) 2_c (c + 2) 


1 — C * 


Under condition 


E/[|^| C ] > 


One has 


(c+2)(c + iy 


m(c) ( [ l x | C+1 /( x ) daA < [ \x\ c f 2 {x) dx. 

V Jr J Jr 


c + 2 > 0 


(3.16) 


Equality holds if and only if f = (1 — |x|) . 


11 


















Next the reader is referred to the definitions of the (2, 2)-th weighted FI and the (2, 2)-th 
FI introduced in m- By Taking into account the 2-th WRP and the 2-th generalized 
deviation for given WF <p(x) = (G' 0*0) we pass to the following assertion. 


3 

Corollary 3.3 Consider the generalized 2-Gaussian PDF, G(x ) = -(l — x 2 ), x 6 (—1,1). 
Let f : R i—> R be a PDF satisfied in 

2 / n2 

3 


^2 (/) > |( J 2,2 


(3.17) 


Define constant w(G) by 


\ 10 / 2 \ - 3/2 

J 2 , 5 /2(G)) (j 2 W 2 X (G) X 


Then the inequality 


/ 2 (x) dx^ < 2 w(G) ^ J x A f(x) dx^ , 


(3.18) 


3 

holds true. The equality occurs when f = -(l — x 2 ) + . Let us note that er 2 (/) in \3.17\) is 
2-th deviation given by 


^2 (/) 


x 2 /(x) dx 


1/2 


Recently, in [13], it has been shown that among all PDFs, the unique distribution that 
minimizes p-th Renyi entropy with (a,p )-th Fisher information is Gaussian. Regarding to 
the weighted version, employing the WF (p, we establish an extended assertion associated 
the generalized Gaussian. The proof is given in Appendix. 

Suppose RV X has PDF /. let (a, b), a,b £ [—oo, oo] be the smallest interval containing 
the support of absolutely continuous PDF /. Define an increasing absolutely continuous 
function s : (a, b ) i->- (—k, k), for some k £ (0, oo] such that Vx € (a, b ) 

rx rs(x ) 

/ f(t) dt = / G(t)dt. 

J a J—k 

Here G represents the generalized Gaussian density. Observe that RV S := s(X) has density 
G. Next consider a WF p(x) > 0. Given p, a and its Holder conjugate f3, introduce 

additional WFs: 

p.(x) = (t>Mr /(1 V fn(x) = ■ (3.19) 

Further, let x E R i —> T{x) € § be an differentiable function. Denoting, as before, the 
derivation of function p by p', define 

Ps(x) = (^(x)/V P (x)) 1/(i_P) , Vv, P (s) = [ s(x)p' s (x)f p {x)dx, (3.20) 

where <p(x) = ip(s(x)). Here 
Ps(x) = Psix) 

Moreover, involving the p -th WRP of G given in Section 2, set 

Kv, p = V<pAs)K, P (G)] P ~ 1 - (3-21) 

One deduces that when ip = 1, rjtp tP (s) and consequently K,p. p (s) are removed. 


1 / g / (x)y / (g(x)) \ + p f ip'jx) \ 

1 ~P\ <p{s(x)) J p-l\ip{x)J 
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Theorem 3.2 (The extended Fisher information inequality (FII) cf. [13], Theorem 3.) Assume 
a < oo, p > 1. Also consider 1/a + l/fd = 1, two RVs Z, Y invoking Beta distributions with 
the first shape parameter 1/a, p/(p — 1) and the second shape parameters (2 p — 1 )/(jp — 1), 

(ct + l)/a respectively. Hence given continuous WF cp 


[Wl 


1 

VI 

[<f(/)i 

1//5 

[AlpOOi 

La- p (G)J 


^ A- p (/) 

Lj^ p p 1 (g)J 


■ A P i i p(Z) - 




(3.22) 


The K VtP (s) refers to \3.21\) . If a < oo, p £ (1/(1 + a),l) substitute A pitP (Y) / A P1)P (Z) in 
A pii p(T)/A pii p(Z). Furthermore, if p = 1 then 


( \ E ck] 

(A^G) E GM/N^if)) 

< 2 - 1 (G )) 1//3 e a (w) - n f [s <?]. 


(3.23) 


Providing W ~ Gamma((a + l)/a, 1), and reduced WF (p(x) 
Finally in case a = oo: 


[ N™ p (G) y ^ 


J^p(f) 

Jod/p(G) 


A 


<p,p- 


ip(s(x )) where ip' = — ip. 

ax 


(3.24) 


Here 

A^ = (j*’|(G)) _i {p- 1 ^ p {s) - 2- l -^{l)-ff{-l)] }. (3.25) 


rx 

where if is given by / <p'(t) dt. 

Jo 


Remark 3.1 Passing to <p = 1, the reduced Eqns. k, 

Thus as result all 13.22\) . 13.23\) . {3.2$ illustrate the same result as (22) in [13 ]/ . 


<p,p\ 


and Ej [T </?'] are vanished. 


Next assertion follows directly from Theorem 13.21 in special case a = 1, p = 1. 

Corollary 3.4 Let X be a RV with density f. Moreover let ( a,b ), a,b £ [— 00 , 00 ] be the 
support of f. For given map s : ( a,b ) i->- (—k,k) for some k £ (0, 00 ], such that for each 


x £ (a, b ) 

px 1 rs(x) 

/ f(t ) df = - / e _|t| d t. (3.26) 

J a J k 

For constant c, consider RV S : s(X) and set 

A s (f) = E f [S 2 S' \S\ C ~ 2 ], B s (f)=E f [S S'e~ cS ]. (3.27) 

Then for — 1 < c one has 

^2 c! exp{2 c }/7V|*| C1 (/)^ < c! 2 c sup |s| c |(log /)'| - c A s (f). (3.28) 

Tnd for — < c < - one nets 
2 2 

f r 1 _ r 2 \ 1/(1—C 2 ) 

(1 ~ 4 c 2 ) ^2 exp j i _ 4 }/(l - c 2 )N^ cs l (f)j (3.29) 

< supe _cs |(log/)'| +c (1 - 4 c 2 ) £ s (/). (3.30) 


Here s' denotes the derivative of s. 
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An application of the extension version MEI and FII provides the following developed 
form of the Cramer-Rao inequality: 

Theorem 3.3 (The extended Cramer-Rao inequality, cf. [T3j, Theorem 5.) Assume the 
suppositions in Theorem I3.il 13.31 For given WF p the reduced WFs ip*, p\ are considered 
as before, d3.il) . d 3. 1.91) . Moreover set 

G) = N™* p (G) NJf up {G)/N™ p (G) N™ p (f). (3.31) 

Then the LHS of inequalities d3. 22}) . IS. 331) and IS. 22 1) becomes 

atf ’ a ^ [wtp^F, G )) p_1 , if a < oo, p > 1, 

and if p = 1, 

(v<pAG) E G [(p\/cr^ a {f)) 

Further, in particular case a = oo, the LHS swaps by 

Oip,a{G) / &ip,a{f) ■ 

Note that we avoid to repeat the RHS of the corresponding inequalities. 


Acknowledgements - SYS thanks the CAPES PNPD-UFSCAR Foundation for the financial 
support in the year 2014-5. SYS thanks the Federal University of Sao Carlos, Department 
of Statistics, for hospitality during the year 2014-5. 

Appendix 

Lemma 4, cf. (13} : Let a, b £ [—oo, oo] and / : (a, b) >-)■ M be an absolutely continuous 
function such that 

lim f(x) = lim f(x) = 0. 


x—^b ' 


Let map g : (a, b) i —> M be an increasing absolutely continuous function such that lim g{t ) 

t—>b 

0, and the integral / , bf' g dx is absolutely convergent. Then 


> 


rb rb 

/ fg'dx = - / f 

J a J a 


g dx. 


Proof of Theorem 3.2: To implement the same steps as in the proof of Theorem 13. II 
cf [13] one shall offer the proof in three cases: 

Casel: p/ 1, q < oo. We begin this case via computing the p-th WRP for RV S := s(t ): 


= 


exp 


</>(s(z)) f p (s') 1 P dx 

f K(s) \ 

l Eg [<p\ J 


l/(i-p) 


P + 1 

P = 1 


(3.32) 
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It can be easily seen that 


t%(G) = h*V)+E f [v log s']- 

Here p(z) = cp(s(z)) and s' is derivative function of s. Now one has 


-v 


JV£p(/)) N™ p (G) 

b \ -p/ (1-p) 


/ fb \ -P/ (1-p) / rb \ 1 

yj V f P dxj ^ J <p(s(x)) f p (s') 1_p dxj 

< / /9 s (x) s' 

J a 


/ (i-p) 


(3.33) 


f p dx. 


The inequality comes from the Holder inequality with in (13.201) . Recall Lemma 4 cf. [ 13 
and the notation in (13.201) . then the RHS of (I3.33P takes the form 

f b 

~P / s{x)p s (x)f p ~ 1 (x)f'(x) dx - % iP (s). 

J a 

At this stage let us focus on the above integral: 

rb 


-p / s{x)p s (x)f p 1 {x)f(x) dx 

J a 

~p(^J (ft( x )) a/{1 ~ p) \ s ( x )\ a f( x ) dx 


1/a 


p(x) p ^^~ l) \ f{x) p - l - 1/a f(x)f da 
<p'.a pua (G) [J^ P2 (/)] 1//3 . 


VP 


This leads 


-p 


(3.34) 


KM)) N™ p (G)< P a pua (G) [JZf(fj] 1/p -kM. 

Eventually using expressions (12.131) and (12.141) gives the required results. 

Case2: a < oo, p = 1. To deduce (13.231) we use Jensen’s inequality. One yields 

/i"(G) = KZ(f) + f <p(x)f(x) log s'(x)dx 
J d 

< h%(f) - E f [p] log E f [(p\ + E f [p\ log f p(x)f(x)s\x)dx. 

J a 

By virtue of Lemma 4 in m and Holder inequality once again, one obtains 
K{G) 

< K~(f) - Ej [<p\ log E f [$\ + log {<r v , a (G) (/)] ^ - E[S (£)']}. 

where f3 as in entire of the paper is the Holder conjugate of a. Therefore applying (12.201) . 
m and Kf[p\ = Eg [</?], completes the proof in this case. 
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Case3: a = oo. Setting s(x) = —k for all x € (— 00 , a] and s(x) = k for all x G [ 6 , 00 ), let 
us go back to (13.331) which gives 


( N v,p(f)) PN vA G )^~f s ( x )Ps{ x )f P ( x ) dx - f s(x)p s (x)(f p {x))'dx 
<kj p s (x)\{f p {x))’\dx - rj^ p {s) 

= P J ™$(f) -Vv,p( s )- 

Therefore the claimed bound is provided. ■ 
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